An Integrated Approach for Content-Based Video Object Segmentation and Retrieval Part I: Semantic Video Object Segmentation and Tracking

نویسندگان

  • Di Zhong
  • Shih-Fu Chang
چکیده

Object-based video and audio data representations, such as MPEG-4, enable unprecedented functionalities of content access and manipulation. In fulfilling the potential, video object segmentation and content-based search techniques remain as two challenging tasks. In this twopart paper, we present an integrated approach for semantic video object segmentation and retrieval. In the first part, we present an active system which combines low level region segmentation with user inputs for defining and tracking semantic video objects. The proposed technique is novel in using an integrated feature fusion framework for tracking and segmentation at both the region and object levels. Experimental results and extensive performance evaluation show excellent results compared to existing systems. In the second part, as an important application of semantic object segmentation, a new prototype system for contentbased video object searching is presented. The system uses the segmentation framework in Part I, but greatly expands it to facilitate powerful object search functionalities, such as spatiotemporal similarity searching at multiple levels.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An integrated approach for content-based video object segmentation and retrieval

Object-based video data representations enable unprecedented functionalities of content access and manipulation. In this paper, we present an integrated approach using region-based analysis for semantic video object segmentation and retrieval. We first present an active system that combines low-level region segmentation with user inputs for defining and tracking semantic video objects. The prop...

متن کامل

An Integrated Approach for Content-Based Video Object Segmentation and Retrieval Part II: Content-Based Searching of Video Objects

In the previous part of this paper, we presented an active object segmentation system which can be used to extract semantic video objects with accurate boundaries. New video representations based on these semantic objects provide great potential for content-based video searching. In this part, we present a new content-based video object searching system. The system uses a novel query model whic...

متن کامل

NeTra-V: Toward an Object-Based Video Representation

We present here a prototype video analysis and retrieval system, called NeTra-V, that is being developed to build an object-based video representation for functionalities such as search and retrieval of video objects. A region-based content description scheme using low-level visual descriptors is proposed. In order to obtain regions for local feature extraction, a new spatio-temporal segmentati...

متن کامل

Integrated Video Object Segmentation and Shape Coding

To enable content-based access and manipulation of video content, modern multimedia communications require per-object based access to video data. Two additional building blocks of video transmission systems needs to be defined, which enable access to video objects at the receiver end. These are video segmentation, which decomposes video frame into a set of layers, where each layer includes segm...

متن کامل

Using a Novel Concept of Potential Pixel Energy for Object Tracking

Abstract   In this paper, we propose a new method for kernel based object tracking which tracks the complete non rigid object. Definition the union image blob and mapping it to a new representation which we named as potential pixels matrix are the main part of tracking algorithm. The union image blob is constructed by expanding the previous object region based on the histogram feature. The pote...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1999